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RELIABLY TRANSMITTING A FRAME TO MULTIPLE DESTINATIONS 
BY EMBEDDING SEQUENCE NUMBERS IN THE FRAME 

TECHNICAL FIELD 

The present invention relates to the field of data communication networks, and 
more particularly to reliably transmitting a firame of data in a multicast manner by 
embedding sequence numbers in the firame. 

BACKGROUND INFORMATION 

Data communication networks have become commonplace in providing 
communications of digital data between a source, e.g., transmitting node, and a 
destination, e.g., destination node. Such systems include a plurality of switches 
and/or various transmission links used to interconnect source nodes and transmission 
nodes. 

Data communication networks may be enable of transmitting firames of data 
in a unicast or multicast manner. Unicast may refer to transmitting a fi^e of data to 
a single destination node. Multicast may refer to transmitting a frame of data to a 
group of recipients, commonly referred to as a multicast group, via a single 
transmission. 

Message transmission fi-om senders, i.e., transmitting nodes, to recipients, i.e., 
destination nodes, may be unreliable, i.e., messages that are sent may not be 
guaranteed to be received properly or in order. Because message transmission in a 
network may be unreliable, methods have been developed to determine the success of 
the delivery of a message such as a multicast fi^e of data. 

One method for determining the success of the delivery of a multicast fi^e 
of data to a multicast group is to embed a single sequence number in the frame. A 
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sequence number may refer to the particular order of the frame transmitted by the 
transmitting node to a particular multicast group with respect to the transmission of 
other frames to that particular multicast group. Each destination node in the multicast 
group may be configured to track the expected sequence number associated with the 
5 multicast frame expected to be received. If the destination node in the multicast 
group receives a multicast frame with the expected sequence number, the destination 
node may be configured to process the received frame and transmit aa 
acknowledgment to the transmitting node, A copy of the multicast frame may be 
maintained in memory by the transmitting node so that it may be retransmitted to 

10 particular members in the multicast group that fail to transmit an acknowledgement. 
Upon receipt of an acknowledgment from a member, i.e., a destination node, in the 
multicast group, the transmitting node may record the acknowledgment in an intemal 
data structure associated with the frame and destination node. Upon receipt of 
acknowledgements from each and every destination node in the multicast group, the 

15 transmitting node may release, i.e., free-up, memory associated with the copy of the 
multicast frame maintained for possible retransmission. 

However, in order to determine the success of the deUvery of a multicast 
frame to a subset of members of a multicast group, i.e., particular destination nodes in 
a multicast group, the multicast frame of data must be transmitted to each member. 

20 That is, the transmitting node may not determine the success of the delivery of a 
multicast frame when the transmitting node transmits a multicast frame to a subset of 
the multicast group, e.g., two of the three members in a multicast group. The 
transmitting node may only determine the success of the delivery of a multicast frame 
when the transmitting node transmits a multicast frame to each member of the 

25 multicast group. Since every member of the multicast group must receive and 

process the sequence number for each frame even if the contents, i.e., payload, of the 
received frames are not needed, the bandwidth of the destination nodes may be 
unnecessarily used. In the case of a data communication network, bandwidth may be 
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unnecessarily used between the switch and the nodes that do not need to process the 
frame contents. Furthermore, since every member of the multicast group must send 
acknowledgements to the transmitting node, those members that do not need to 
receive and process the frame contents may transmit unnecessary acknowledgments 
5 to the transmitting node. By transmitting unnecessary acknowledgments, the 
processing power of those destination nodes and of the transmitting node may be 
unnecessarily used. Furthermore, by transmitting unnecessary acknowledgments the 
bandwidth of the network may be imnecessarily used. Furthermore, if a frame that is 
transmitted to a destination node such as a destination node that does not need to 
10 process the frame contents is lost, or if this destination node is temporarily unable to 
process the frame sequence nxmiber, or if the acknowledgement that this destination 
node transmits back to the transmitting node is lost, the transmitting node will 
retransmit the frame to that destination node thereby unnecessarily using resources in 
the transmitting node, destination node and in the data communication network. 

15 It would therefore be desirable to be able to determine the success of the 

delivery of a multicast frame to a subset of members of a multicast group without 
transmitting the multicast frame to each member of the multicast group. By being 
able to detemiine the success of the delivery of a multicast frame to a subset of 
members of a multicast group without transmitting the multicast frame to each 

20 member of the multicast group, fewer resources are used in the transmitting node, in 
the data commimication network and in those destination nodes that no longer need to 
receive the frame or send an acknowledgment. 
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SUMMARY 

The problems outlined above may at least in part be solved in some 
embodiments by inserting two or more sequence numbers in the frame, e.g., multicast 
frame, to be transmitted where each sequence number is associated with a particular 
5 destination node to receive the transmitted frame. 

In one embodiment of the present invention, a method for reliably transmitting 
a frame, e.g., multicast frame, may comprise the step of a transmitting node inserting 
appropriate bits in a frame header of the frame to select appropriate ports of a switch 
fabric from which to transmit the frame to the appropriate destination nodes. The 

10 switch fabric may be coupled to the transmitting node and a plurality of destination 
nodes. The transmitting node may fiuther set a bit in the frame header of the frame to 
indicate whether an explicit or impUcit acknowledgment is required from the 
destination node that receives the frame. An expHcit acknowledgment may refer to 
requiring the destination node that received the frame to transmit a response to the 

15 transmitting node to transmit the next frame to be transmitted to that destination node 
with the next higher sequence number. For example, if the transmitting node 
transmitted a frame with a sequence number of the binary number 00000001 and the 
fi"ame had a bit set to indicate an explicit acknowledgment is required from the 
destination node, then the destination node may transmit a response requesting that 

20 the next fi^e to be transmitted to that destination node have a sequence number of 
the binary number 00000010, An implicit acknowledgment may refer to not 
requiring the destination node that received the frame to transmit a response 
acknowledging the deUvery of the frame. 

The traasmitting node may insert two or more sequence numbers in 
25 appropriate entries in an identifier field in the frame to be transmitted. The identifier 
field may be part of the frame header. The identifier field may comprise a plurality of 
entries where each entry may be associated with a particular destination node coupled 
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to the transmitting node via the switch fabric. Each entry in the identifier may store a 
particular sequence number that is used by the associated destination node. A 
sequence number may refer to the particular order of the frame transmitted by the 
transmitting node to a particular destination node with respect to the transmission of 
5 other frames to that destination node. The transmitting node may then msert two or 
more sequence numbers in the appropriate entries in the identifier field to identify the 
destination nodes to receive the transmitted frame. 

Upon transmitting the frame, the transmitting node may store a copy of the 
transmitted frame. The transmitting node may then determine if the transmitting node 

10 has received a request to retransmit a frame from one of the plurality of destination 
nodes coupled to the transmitting node. A destination node may be configured to 
transmit a request to the transmitting node to retransmit a frame with its expected 
sequence number upon that destination node receiving a frame with a sequence 
number greater than the expected sequence number. If the transmitting node receives 

15 such a request, then the transmitting node may retransmit the requested frame. Upon 

retransmitting the frame, the transmitting node may wait to receive an 
acknowledgment from one of the plurahty of destination nodes. If the transmitting 
node has not received a request to retransmit a frame, e.g., multicast frame, from one 
of the plurahty of destination nodes, then the transmitting node may determine if it 

20 has received an acknowledgment from one of the plurality of destination nodes. If 
the transmitting node has not received an acknowledgment from one of the plurality 
of destination nodes, then the transmitting node may wait to receive an 
acknowledgment from one of the plurality of destination nodes. 

If the transmitting node has received an acknowledgment from one of the 
25 plurality of destination nodes then the transmitting node may identify the appropriate 

destination node and the sequence number associated with the received frame. The 
transmitting node may then read data structures associated with the frames 
transmitted by the transmitting node. Each frame transmitted may be associated with 
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a data structure storing information as to which destination node was to receive the 
frame as well as the associated sequence number. The sequence number may indicate 
the sequence that the frame was sent to the associated destination node with respect to 
other frames transmitted to that destination node. 

5 Upon reading the data structures associated with the frames transmitted, the 

transmitting node may identify the frame associated with the acknowledgment 
received. Upon identifying the frame associated with the received acknowledgment, 
the transmitting node may indicate that the transmitting node received the 
acknowledgment from the appropriate destination node in the data structure 
1 0 associated with the identified frame. 

The transmitting node may further read the data structure of the destination 
node associated with the frame identified. The transmitting node may store a data 
structure for each of the destination nodes that are to receive a frame transmitted by 
the transmitting node. The data structure may comprise one or more entries where 

15 each entry may comprise a frame identification and a sequence number where the 

sequence number is the sequence that the frame was transmitted to the destination 
node of the data structure with respect to other frames transmitted to that destination 
node. The data structure may fiirther comprise information as to whether the frame 
identified by the frame identification was transmitted with a request to transmit an 

20 acknowledgment or not. The transmitting node may then indicate that the frame was 
dehvered to the destination node in the data structure. 

The transmitting node may then determine if there are any entries in the data 
structure of the destination node with any impUcit acknowledgments that need to be 
identified. For example, since a destination node may transmit an acknowledgment 
25 upon receiving a frame with an expected acknowledgment, the transmitting node may 
identify any previous frames with an implicit acknowledgment as having been 
received by the destination node. If the transmitting node identifies any entries with 
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an implicit acknowledgment that needs to be identified, then the transmitting node 
may identify these entries. Upon identifying any entries associated with the imphcit 
acknowledgment, the transmitting node may identify these entries in the data 
stracture(s) associated with the frame(s) with the imphcit acknowledgment. 

5 If the transmitting node does not identify any entries in the data structure of 

the destination node with any implicit acknowledgments that need to be identified 
then the transmitting node may determine if there is a missing sequence number. As 
stated above, the transmitting node may indicate that the transmitting node received 
an acknowledgment that the frame was delivered for the appropriate frame in the data 

10 structure for the appropriate destination node. If the transmitting node identifies a 
frame associated with the received acknowledgment with a sequence number that is 
greater than expected, then the trmsmitting node may detect a lost acknowledgment. 
For example, if the transmitting node transmitted frame #1 followed by frame #2 to 
destination node #1, where both frame #1 and #2 were transmitted with a request to 

15 transmit an acknowledgment, and received an acknowledgment from destination node 
#1 that it received frame #2 without receiving an acknowledgment from destination 
node #1 that it received frame #1, then the transmitting node may have detected that 
the acknowledgment that the destination node received frame #1 was lost. 

If the transmitting node does not identify a missing sequence nxxmber, then the 
20 transmitting node may determine if there are any outstanding responses for the frame 
received. As stated above, each frame may be associated with a data structure. As an 
acknowledgment from each destination node for a particular frame is received, the 
transmitting node may indicate in the appropriate entry in the appropriate data 
structure associated with the deUvered frame that the frame was dehvered. That is, 
25 the transmitting node may indicate each destination node that issued an 

acknowledgment. The transmitting node may then determine if there are any more 
destination nodes that have not issued an acknowledgment of having received the 
particular frame in question. If there are outstanding responses, i.e., any outstanding 
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acknowledgments from any destination nodes, then the transmitting node may wait to 
receive a further acknowledgment from another destination node. If the transmitting 
node has identified all the destination nodes that were transmitted the frame identified 
as having transmitted an acknowledgment, then the transmitting node may release 
5 memory associated with a single copy of the frame identified. By transmitting a 
frame, e.g., multicast frame, with sequence numbers associated with destination 
nodes, the transmitting node may be able to store a single copy of the transmitted 
frame instead of multiple copies of the transmitted frame. Subsequently, fewer 
resources may be used for storing copies of transmitted frames. 

10 The foregoing has outlined rather broadly the features and technical 

advantages of the present invention in order that the detailed description of the 
invention that follows may be better understood. Additional features and advantages 
of the invention will be described hereinafter which form the subject of the claims of 
the invention. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

A better understanding of the present invention can be obtained when the 
following detailed description is considered in conjunction with the following 
drawings, in which: 

Figure 1 illustrates a network system configured in accordance with the 
present invention; 

Figure 2 illustrates an embodiment of the present invention of nodes in a 
network system; 

Figure 3 is a flowchart of a method for reUably transmitting a frame in 
accordance with the present invention; 

Figure 4 illustrates an embodiment of the present invention of a frame; 
Figure 5 illustrates an embodiment of the present invention of an identifier 

field in a frame; 

Figure 6 is a flowchart of a method for responding by a destination node to a 
received frame; 

Figure 7 illustrates a data structure associated with each frame maintained by 
the transmitting node in accordance with the present invention; and 

Figure 8 illustrates a data structure associated with each destination node 
maintained by the transmitting node in accordance wiflx the present invention. 
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DETAILED DESCRIPTION 

The present invention comprises a method, system and computer program 
product for reliably transmitting a frame. In one embodiment of the present 
invention, a transmitting node may be coupled to a plurality of destination nodes. 
5 The transmitting node may insert in a frame, e.g., multicast frame, to be transmitted 
to any two or more destination nodes coupled to the transmitting node two or more 
sequence numbers in the frame to be transmitted. The two or more sequence numbers 
may be associated with the two or more destination nodes. Upon transmitting the 
frame, the transmitting node may store a copy of the frame transmitted. Upon 

10 verifying that the frame has been delivered to each destination node to receive the 
frame, the memory associated with the transmitted frame may be released. It is noted 
that even though the following discusses inserting sequence numbers in a fiume, e.g., 
multicast frame, to identify the destination nodes to receive the frame that the present 
invention may include an embodiment of inserting sequence numbers in a particular 

15 frame in a Protocol Data Unit (PDU) comprised of a series of frames. That is, the 

sequence numbers may only need to appear once in the PDU and not in every frame 
of the PDU. 

Figure 1 - Network System 

Figure 1 illustrates an embodiment of the present invention of a network 
20 system 100. Network system 100 may comprise a transmitting node 101 coupled to a 

pluraUty of destination nodes 103A-F via a switch fabric 102, e.g., Intemet switch. 
Destination nodes 103A-F may collectively or individually be referred to as 
destination nodes 103 or destination node 103, respectively. Transmitting node 101 
may be configured to transmit one or more frames of data, e.g., multicast frames of 
25 data, to two or more destination nodes 102 via switch fabric 102. Switch fabric 102 
may comprise a plurality of ports 104A-F coupled to a plurality of destination nodes 
103A-F. Ports 104A-F may collectively or individually be referred to as ports 104 or 

10 
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port 104, respectively. Each port 104 may be associated with a particular destination 
node 103 as illustrated in Figure 1. Switch fabric 102 may be configured to direct a 
particular jframe, e.g., multicast JBrame, received from transmitting node 101 to the 
appropriate two or more destination nodes 103 by directing the particular frame 
5 through the appropriate ports 104 coupled to the appropriate destination nodes 103. It 
is noted that system 100 may comprise any number of destination nodes 103 coupled 
to switch fabric 102. It is further noted that switch fabric 102 may comprise any 
number of ports 104. It is further noted that system 100 may comprise any number of 
transmitting nodes 101 and associated switch fabrics 102 and that Figure 1 is not to 
10 be limited in scope to any one particular embodiment. 

Figure 2 - Hardware Configuration of Nodes 

Figure 2 illustrates an embodiment of the present invention of nodes 101, 103. 
It is noted that the description provided below describes an exemplary embodiment of 
nodes 101, 103 and that the embodiments of nodes 101, 103 are not to be limited in 
15 scope to any one particular embodiment. For example, node 103 may not comprise 
an operating system as illustrated in Figure 2 and subsequently the program of the 
present invention that responds to a received frame as described in the discussion of 
Figure 6 may be implemented as a communications device driver. 

Referring to Figure 2, nodes 101, 103 may comprise a central processing unit 
20 (CPU) 210 coupled to various other components by system bus 212. An operating 
system 240, e.g., AIX, UNIX, may run on CPU 210 and provide control and 
coordinate the function of the various components of Figure 2. An appUcation 250 in 
accordance with the principles of the present invention may run in conjunction with 
operating system 240 and provide output calls to operating system 240 where the 
25 output calls implement the various functions or services to be performed by 
application 250. In one embodiment, application 250 of node 101 may include for 
example, a program for reliably transmitting frames of data as described in the 
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discussion of Figure 3. In one embodiment, application 250 of node 103 may include 
for example, a program for responding to a received frame as described in the 
discussion of Figure 6. 

Referring to Figure 2, read only memory (ROM) 216 may be coupled to 
5 system bus 212 and include a basic input/output system ("BIOS") that controls certain 
basic functions of node 101, 103. Random access memory (RAM) 214, I/O adapter 
218, and communications adapter 234 may also be coupled to system bus 212. It 
should be noted that software components including operating system 240 and 
application 250 may be loaded into RAM 214 which is the computer system's main 

10 memory. I/O adapter 218 may be a small computer system interface ("SCSI") adapter 
that communicates with disk unit 220, e.g., disk drive. It is noted that the program of 
the present invention that rehably transmits frames of data, as described in the 
discussion for Figure 3, may reside in disk unit 220 or application 250 of node 101. It 
is ftirther noted that the program of the present invention that responds to a received 

15 frame, as described in the discussion for Figure 6, may reside in disk unit 220 or 

application 250 of node 103. 

Referring to Figure 2, communications adapter 234 may interconnect bus 212 
with an outside network enabling transmitting node 101 to transmit frames via switch 
fabric 102 to destination nodes 103. Furthermore, communications adapter 234 may 
20 interconnect bus 212 with an outside network enabhng destination node 103 to 
receive frames of data via switch fabric 102 from transmitting node 101. 

Referring to Figure 2, keyboard 224, mouse 226 and speaker 230 may all be 
interconnected to bus 212 through user interface adapter 222. Event data may be 
inputted to node 101, 103 through any of these devices. Display monitor 238 may be 
25 connected to system bus 212 by display adapter 236. In this manner, a user may be 
capable of inputting to node 101, 103 through keyboard 224 or mouse 226 and 
receiving output from node 101, 103 via display 238 or speaker 230. 
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Implementations of the invention include implementations as a computer 
system programmed to execute the method or methods described herein, and as a 
computer program product. According to the computer system implementations, sets 
of instructions for executing the method or methods are resident in the random access 

5 memory 214 of one or more computer systems configured generally as described 
above. Until required by node 101, 103, the set of instructions may be stored as a 
computer program product in another computer memory, for example, in disk drive 
220 (which may include a removable memory such as an optical disk or floppy disk 
for eventual use in disk drive 220). Furthermore, the computer program product can 

10 also be stored at another computer and transmitted when desired to the user's work 
station by a network or by an external network such as the Internet. One skilled in the 
art would appreciate that the physical storage of the sets of instructions physically 
changes the medium upon which it is stored so that the medium carries computer 
readable information. The change may be electrical, magnetic, chemical or some 

1 5 other physical change. 

Figure 3 - Method for Reliably Transmitting a Frame of Data 

Figure 3 illustrates a flowchart of one embodiment of the present invention of 
a method 300 for reliably transmitting a frame, e.g., multicast frame, to two or more 
destination nodes 103 by transmitting node 101 via switch fabric 102. As stated in 

20 the Background Information section, one method for determining the success of the 
dehvery of a multicast frame to a multicast group is to embed a single sequence 
number in the frame. A sequence nimiber may refer to the particular order of the 
frame transmitted by the transmitting node to a particular multicast group with respect 
to the transmission of other frames to that particular multicast group. However, in 

25 order to determine the success of the delivery of a multicast frame to a subset of 

members of a multicast group, i.e., particular destination nodes in a multicast group, 
the multicast frame must be transmitted to each member. That is, the transmitting 
node may not determine the success of the dehvery of a multicast frame when the 
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transmitting node transmits a multicast frame to a subset of the multicast group, e.g., 
two of the three members in a multicast group. The transmitting node may only 
determine the success of the delivery of a multicast frame when the transmitting node 
transmits a multicast frame to each member of the multicast group. It would 
5 therefore be desirable to be able to determine the success of the delivery of a 
multicast frame to a subset of members of a multicast group without transmitting the 
multicast frame to each member of the multicast group. By being able to determine 
the success of the deUvery of a multicast frame to a subset of members of a multicast 
group without transmitting the multicast frame to each member of the multicast 

10 group, fewer resources are used in the transmitting node, in the data communication 
network and in those destination nodes that no longer need to receive the frame or 
send an acknowledgment. Method 300 is a method for determining the success of the 
dehvery of a multicast frame to a subset of a multicast group, e.g., two of the three 
destination nodes of the multicast group, without transmitting the multicast frame to 

1 5 each member of the multicast group. 

In step 301, transmitting node 101 may insert appropriate bits in a frame 
header of a frame, as illustrated in Figure 4, to select appropriate ports 104 of switch 
fabric 102 from which to transmit the frame to the appropriate destination nodes 103. 
Referring to Figure 4, Figure 4 illustrates an embodiment of the present invention of a 

20 frame 400, e.g., multicast frame, where frame 400 may comprise a header field 401, 
an identifier field 402 and a payload 403. Header field 401 may comprise 
information, e.g., bits of information, as to which ports 104 in switch fabric 102 may 
be used to transmit the frame to the appropriate two or more destination nodes 103. 
Header field 401 may fiirther comprise information, e.g., a bit of information, as to 

25 whether the frame requires an explicit or impUcit acknowledgment from the received 
destination nodes 103 as explained in greater detail below. Identifier field 402 may 
comprise a plurality of entries where each entry may store a sequence number 
associated with a particular destination node 103 coupled to transmitting node 101. 
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For example, referring to Figure 1, since there are six destination nodes 103 coupled 
to transmitting node 101 via switch fabric 102, there may be six entries to insert six 
sequence numbers in identifier field 402 as illustrated in Figure 5. 

Figure 5 illustrates an embodiment of the present invention of identifier field 
5 402. Referring to Figure 5, identifier field 402 may comprise a plurality of entries 
501A-F which may be associated with destination nodes 103A-F. Entries may 
collectively or individually be referred to as entries 501 or entry 501, respectively. It 
is noted that identifier field 402 may comprise any number of entries 501 and that 
Figure 5 is illustrative. Each entry 501 may store a sequence number associated with 

10 a particular destination node 103 associated with that entry 501. A sequence number 
may refer to the particular order of the frame transmitted by transmitting node 101 to 
a particular destination node 103 with respect to the transmission of other frames to 
that particular destination node 103. For example, the entry 501 A in identifier field 
401 may contain the sequence number associated with destination node 103 A. Entry 

15 501B may contain the sequence number associated with destination node 103B. 

Entry 501 C may contain the sequence number associated with destination node 103C. 
Entry 501D may contain the sequence number associated with destination node 103D. 
Entry 50 IE may contain the sequence number associated with destination node 103E. 
Entry 501F may contain the sequence number associated with destination node 103F. 

20 In one embodiment, each sequence number used to identify a particular destination 
node 103 may be embodied in a 16-bit word That is, each entry 501 may have a 
length of 16 bits. 

Referring to Figure 4, payload 403 of frame 400 may comprise data, e.g., 
video, audio, images. It is noted that identifier field 402 may be part of header field 
25 401 . It is further noted that frame 400 may comprise any number of fields containing 
any type of information and that Figure 4 is illustrative. 
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Referring to Figure 3, in step 302, a bit may be set to indicate whether an 
explicit or implicit acknowledgment is required from the destination node 103 that 
receives the frame. An explicit acknowledgment may refer to requiring destination 
node 103 that received that frame to transmit a response to transmitting node 101 to 
5 transmit the next frame to be transmitted to that destination node 103 with the next 

higher sequence number. For example, if transmitting node 101 transmits frame #1 
with a sequence number of the binary number 00000001, where frame #1 has a bit set 
to indicate an explicit acknowledgment, then destination node 103 may be configured 
to transmit a response requesting transmitting node 101 to transmit the next frame to 

10 be transmitted to that destination node 103 with the next higher sequence number, 
e.g., binary number 00000010. An implicit acknowledgment may refer to not 
requiring destination node 103 that received that frame to transmit a response 
acknowledging the deUvery of the frame. The delivery of frames marked with an 
impUcit acknowledgment may be verified upon transmitting node 101 receiving an 

15 explicit acknowledgment from a subsequent deUvered frame as described in 

additional detail below. 

In step 303, transmitting node 101 may insert two or more sequence numbers 
in the appropriate entries 501 in identifier field 402 of frame 400 to identify the 
destination nodes 103 to receive the transmitted frame. As stated above, each 

20 sequence number may be used to identify a particular destination node 103 to receive 
a frame, e.g., multicast frame, from transmitting node 101. For example, referring to 
Figure 1, if transmitting node 101 intends to transfer a particular frame, e.g., multicast 
frame, to destination nodes 103A, 103C, then transmitting node 101 may insert the 
appropriate sequence number in entries 501 A, 501 C. The other entries 501 in 

25 identifier field 402 may be empty, e.g., comprise zero's. 

In step 304, transmitting node 101 may transmit the frame, e.g., multicast 
frame, to two or more destination nodes 103 through the appropriate ports 104 of 
switch fabric 102 as indicated in step 301. A description of possible responses by 
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each destination node 103 that received a transmitted frame is described ftirther below 
in conjunction with the discussion of Figure 6. 

In step 305, a copy of the transmitted frame may be saved in memory, e.g., 
RAM 214, or in a storage medium, e.g., disk unit 220, by transmitting node 101. 

5 Referring to Figure 6, Figure 6 illustrates a flowchart of one embodiment of 

the present invention of a method 600 for responding by a destination node 103 upon 
receiving a fl^e, e.g., multicast frame. 

In step 601, a particular destination node 103, e.g., destination node 103 A, 
may receive a frame, e.g., multicast frame, transmitted by transmitting node 101 in 
10 step 304. 

Upon receipt of the frame, destination node 103, e.g., destination node 103A, 
may read the received frame, e.g., read header field 401 and identifier field 402, in 
step 602. Destination node 103, e.g., destination node 103A, may read the sequence 
number, e.g., binary number 00000110, associated with it in the appropriate entry 
15 501, e.g., entry 501 A, in identifier field 402 of frame 400 in step 602. For example, 
destination node 103A may be configured to read entry 501A in identifier field 402 
associated with destination node 103 A. Entry 501 A may contain the sequence 
number, e.g., binary number 00000110, associated with the transmitted frame for 
destination node 103 A. 

20 In step 603, destination node 103, e.g., destination node 103A, may determine 

if the sequence number read in step 602 is less than the expected sequence number. 
Each destination node 103 may be configured to track the expected sequence number 
associated with the frame, e.g., multicast frame, expected to be received. If the 
sequence number read in step 602 is less than the expected sequence number, then 

25 destination node 103, e.g., destination node 103A, may discard the received ^ame in 
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step 604. Destination node 103 may be configured to discard the received frame in 
step 604 since the frame may have been a retransmission. 

If the sequence number read in step 602 is not less than the expected sequence 
number, then destination node 103, e.g., destination node 103 A, may determine if the 
5 sequence number read in step 602 is greater than the expected sequence number in 
step 605. If the sequence number read in step 602 is greater than the expected 
sequence number, then destination node 103 may transmit a request to transmitting 
node 101 to transmit the frame, e.g., multicast frame, associated with the expected 
sequence number in step 606. 

10 If the sequence nimiber read in step 602 is not greater than the expected 

sequence number, then the sequence number matches the expected sequence number 
and the frame is processed by destination node 103, e.g., destination node 103 A, in 
step 607. 

In step 608, a determination may be made by destination node 103, e.g., 
15 destination node 103 A, as to whether an explicit acknowledgment is required by 

transmitting node 101. As stated above, destination node 103 may be configured to 
read the frame, e.g., header field 401, identifier field 402, in step 602. Header field 
401 may comprise information, e.g., a bit of information, as to whether transmitting 
node 101 requires an explicit or implicit acknowledgment from the received 
20 destination nodes 103. Upon reading header field 401, destination node 103, e.g., 

destination node 103 A, may be configured to determine if an expUcit 
acknowledgment is required by transmitting node 101 . 

If an explicit acknowledgment is required by transmitting node 101, then 
destination node 103, e.g., destination node 103 A, may transmit an acknowledgment 
25 in step 609. In one embodiment, the acknowledgment may comprise a request to 
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transmit the next frame to be transmitted to that destination node 103, e.g., destination 
node 103A, with the next higher sequence number, e.g., binary number 000001 11. 

If an expHcit acknowledgment is not required by transmitting node 101, then 
destination node 103, e.g., destination node 103A, may not transmit an 
5 acknowledgment in step 610. 

Returning to Figure 3, transmitting node 101 may determine if transmitting 
node 101 has received a request to retransmit a frame, e.g., multicast frame, from one 
of the plurality of destination nodes 103 coupled to transmitting node 101 in step 306. 
As stated above, destination node 103, e.g., destination node 103A, may be 

10 configured to transmit a request to transmitting node 101 to retransmit a frame with 
its expected sequence number upon that destination node 103 receiving a frame with 
a sequence number greater than the expected sequence number. If transmitting node 
101 has received a request to retransmit a frame, e.g., multicast frame, from one of 
the plurality of destination nodes 103, then transmitting node 101 may retransmit the 

15 frame, e.g., multicast frame, associated with the received sequence number in step 
307. A description of identifying the frame associated with the received sequence 
number is described fiurther below. Upon retransmitting the frame, transmitting node 
101 may wait to receive an acknowledgment from one of the plurality of destination 
nodes 103 in step 308. 

20 If transmitting node 101 has not received a request to retransmit a frame, e.g., 

multicast frame, from one of the plurahty of destination nodes 103, then transmitting 
node 101 may determine if it has received an acknowledgment from one of the 
plurality of destination nodes 103 in step 309. If transmitting node 101 has not 
received an acknowledgment from one of the pluraUty of destination nodes 103, then 

25 transmitting node 101 may wait to receive an acknowledgment from one of the 
plurality of destination nodes 103 in step 308 
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If transmitting node 101 has received an acknowledgment from one of the 
plurality of destination nodes 103, then transmitting node may identify the 
appropriate destination node 103, e.g., destination node 103A, and the sequence 
number associated with the received frame in step 310. As stated above, upon 
5 destination node 103 receiving a frame with a sequence number that matches an 
expected sequence number, destination node 103 may be configured to transmit an 
acknowledgment to transmitting node 101. The acknowledgment may comprise a 
request to transmit the next frame to be transmitted to that destination node 103 with 
the next higher sequence number. Transmitting node 101 may be configured to 
10 identify the destination node 103, e.g., destination node 103 A, that transmitted the 
acknowledgment as well as the sequence number associated with the received frame. 
The sequence number associated with the received frame is the next lower sequence 
number from the sequence number in the acknowledgment. 

In step 311, transmitting node 101 may read data structures associated with 
15 frames, e.g., multicast frames, transmitted by transmitting node 101. In one 
embodiment, each frame transmitted may be associated with a data structure, as 
illustrated in Figure 7, configured to identify which destination nodes 103 received 
that particular frame. Furthermore, the data structure of the frame may comprise the 
sequence numbers associated with each destination node 1 03 to receive the frame. In 
20 one embodiment, the data structures may be stored in memory, e.g., RAM 214, or in a 

storage medium, e.g., disk unit 220. 

Referring to Figure 7, Figure 7 illustrates an embodiment of the present 
invention of data structures 701A-D. Data structures 701 A-D may collectively or 
individually be referred to as data structures 701 or data structure 701, respectively. 
25 It is noted that data structure 701 may comprise any number of entries storing any 
type of information and that Figure 7 is illustrative. It is fiuther noted that 
transmitting node 101 may transmit any number of frames and hence may store any 
number of data structures 701. As stated above, each data structure 701 may be 
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associated with a particular frame transmitted by transmitting node 101. For 
example, frame #1 may be associated with data structure 701A. Frame #2 may be 
associated with data structure 701B. Frame #3 may be associated with data structure 
701C. Frame #4 may be associated with data structure 701D. As stated above, each 
5 data structure 701 may comprise information as to which destination nodes 103 were 
to receive the frame associated with data structure 701 as well as the sequence 
numbers associated with each destination node 103 to receive the frame. For 
example, destination nodes 103A, 103C and 103E are to receive frame #1. Each 
destination node 103, e.g., destination nodes 103A, 103C, 103E, has a sequence 

10 number of 1 associated with frame #1. Destination nodes 103B, 103D and 103F are 
to receive frame #2. Each destination node 103, e.g., destination nodes 103B, 103D, 
103F, has a sequence nimiber of 1 associated with frame #2. Destination nodes 
103A, 103B and 103C are to receive frame #3. Each destination node 103, e.g., 
destination nodes 103 A, 103B, 103C, has a sequence number of 2 associated with 

15 frame #3. Destination nodes 103B, 103C and 103D are to receive frame #4. 
Destination nodes 103B and 103C have a sequence number of 3 associated with 
frame #4; whereas, destination nodes 103D has a sequence mmiber of 2 associated 
with frame #4. 

Upon reading the data structures associated with frames, e.g., multicast 
20 frames, transmitted by transmitting node 101, transmitting node 101 may identify the 
fiume associated with the acknowledgment received in step 312. For example, if 
transmitting node 101 receives an acknowledgment that requests sequence number 4 
from destination node 103B, then transmitting node 101 may identify the frame, e.g., 
frame #4, transmitted to destination node 103B with sequence number 3 as being 
25 delivered to destination node 103B. Upon identifying the appropriate destination 
node 103, e.g., destination node 103B, and the sequence number associated with the 
delivered frame, transmitting node may read the data structures for a matching 
destination node 103 and sequence number pair. Referring to Figure 7, frame #4 
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comprises an entry listing destination node 103B and sequence number 3. 
Subsequently, in step 312, transmitting node 101 may identify frame #4 as being 
associated with the acknowledgment received. 

Upon identifying the frame associated with acknowledgment received in step 
5 312, transmitting node 101 may indicate the received acknowledgment from the 
appropriate destination node 103, e.g., destination node 103B, in data structure 701 
associated with the transmitted frame in step 313. For example, transmitting node 
101 may indicate in the first entry in data structure 70 ID that the frame associated 
with data structure 70 ID has been delivered by marking that entry. 

10 In step 314, transmitting node 101 may read the data structure of destination 

node 103, e.g., destination node 103B, associated with the frame identified in step 
312. Figure 8 illustrates an embodiment of a data structure 801 for a destination node 
103, e.g., destination node 103B. It is noted that data structure 801 may comprise any 
number of entries storing any type of information and that Figure 8 is illustrative. In 

15 one embodiment, transmitting node 101 may be configured to store data structure 801 
associated with each destination node 103 in memory, e.g., RAM 214, or in a storage 
medium, e.g., disk unit 220. Data structure 801 may comprise particular frame 
identifications, e.g., frame numbers, where each frame identification may be 
associated with a particular sequence number. As stated above, the sequence number 

20 indicates when the frame was transmitted by transmitting node 101 with respect to the 

other frames transmitted to destination node 103 associated with data structure 801. 
For example, referring to Figure 8, frame #2, i.e., the frame associated with data 
structure 701B, has a sequence number of 1. Frame #3, i.e., the frame associated with 
data structure 701 C, has a sequence number of 2. Frame #4, i.e., the frame associated 

25 with data structure 70 ID, has a sequence number of 3. Thus, frame #2 was 

transmitted to destination node 103, e.g., destination node 103B, followed by frame 
#3 which was then followed by frame #4. 
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Referring to Figure 8, each entry of data structure 801 may further comprise 
information as to whether the frame as identified by the frame identification was 
transmitted with a request to transmit an acknowledgment or not. Referring to Figure 
8, frame #2 associated with data structure 701B was transmitted with a request to 
5 transmit an acknowledgment as indicated by "EX." Frame #3 associated with data 
structure 70 IC was transmitted with a request not to transmit an acknowledgment as 
indicated by "IX." Frame #4 associated with data structure 701D was transmitted 
with a request to transmit an acknowledgment. 

Upon reading the data structure of destination node 103, e.g., destination node 
10 103B, associated with the frame identified in step 312, transmitting node 101 may 

indicate the received acknowledgment for the appropriate frame in step 315. For 
example, transmitting node 101 may indicate in the third entry in data structure 801 
that frame #4, i.e., the frame associated with data structure 701D, associated with 
sequence number 3 has been delivered by marking that entry. 

15 In step 316, transmitting node 101 may determine if there are any previous 

entries in data structure 801 read in step 314 that have not been identified, e.g., 
marked. That is, transmitting node 101 may determine if there are any previously 
transmitted frames that have not been identified as having been received by 
destination node 103 in data structure 801 read in step 314. 

20 If there are any previous entries in data structure 801 read in step 314 that 

have not been identified, e.g., marked, then transmitting node 101 may determine if 
the previous unidentified entry is an implicit acknowledgment that needs to be 
identified in step 317. For example, since destination node 103, e.g., destination node 
103B, may transmit an acknowledgment upon receiving a frame wilii an expected 

25 acknowledgment, transmitting node 101 may identify any previous frames with an 
implicit acknowledgment as having been received by the destination node 103, e.g., 
destination node 103B. If transmitting node 101 identifies the previous entry as an 
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implicit acknowledgment that needs to be identified, then transmitting node 101 may 
identify that entry m step 318. For example, referring to Figure 8, if destination node 
103B transmitted an acknowledgment that it received frame #4, i.e^, the frame 
associated with data structure 701D, then transmitting node 101 may identify frame 

5 #3, i.e., the frame associated with data structure 701 C with an implicit 
acknowledgment, was received as well Upon identifying the entry associated with 
the implicit acknowledgment, transmitting node 101, in step 319, may identify the 
entry in data structure 701, e.g., data structure 701C, of the frame, e.g., frame #3, 
associated with the impUcit acknowledgment. That is, in step 319, transmitting node 

10 101 may identify the entry in data structure 701 of the frame associated with the 
implicit acknowledgment that contains the destination node 103 that transmitted the 
acknowledgment and the associated sequence number. For example, referring to 
Figure 7, transmitting node 101 may identify the second entry of data structure 701C, 
i.e., data structure 701 of frame #3. 

15 Upon identifying the entry in data structure 701, e.g., data structure 701C, of 

the frame, e.g., frame #3, associated with the implicit acknowledgment, transmitting 
node 101 may determine if there are any previous entries in data structure 801 read in 
step 314 that have not been identified, e.g., marked, in step 315. 

Referring to step 317, if transmitting node 101 does not identify the previous 
20 unidentified entry as an implicit acknowledgment that needs to be identified, then 
transmitting node 101 detected a lost acknowledgment in step 320. As stated above, 
transmitting node 101 may indicate that an acknowledgment has been received in data 
structure 801 of the appropriate destination node 103 in step 315. If transmitting 
node 101 identifies a frame associated with the received acknowledgment with a 
25 sequence number that is greater than expected, then transmitting node 101 detects a 

lost acknowledgment in step 320. For example, referring to Figure 8, if transmitting 
node 101 indicates that transmitting node 101 received an acknowledgment for frame 
#4 corresponding to a sequence number of 3 prior to receiving an acknowledgment 
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for frame #2 corresponding to a sequence number of 1, then transmitting node 101 
detected a lost acknowledgment, i.e., the acknowledgment for frame #2 was lost. It is 
noted that transmitting node 101 expects to receive an acknowledgment for frames 
with an explicit acknowledgment and hence the determination of a missing sequence 
5 number is based on frames with an exphcit acknowledgment. 

Upon detecting a lost acknowledgment in step 320, transmitting node 101 may 
determine, in step 316, if there are any previous entries ui data structure 801 read in 
step 314 that have not been identified, e.g., marked. 

Referring to step 316, if there are no previous entries in data structure 801 
10 read in step 314 that have not been identified, then transmitting node 101 may 

determine if there are any outstanding responses for the frame, e.g., multicast frame, 
received in step 321. As stated above, each frame may be associated with data 
structure 701. As an acknowledgment from each destination node 103 for a particular 
frame is received, transmitting node 101 may indicate in the appropriate entry in the 
15 appropriate data structure 701 associated with the delivered frame that the frame was 

delivered. That is, transmitting node 101 may indicate each destination node 103 that 
issued the acknowledgment. Transmitting node 101 may then determine if there are 
any more destination nodes 103 that have not issued an acknowledgment of having 
received the particular frame in question in step 321. That is, transmitting node 101 
20 may determine if there are any outstanding responses, i.e., any outstanding 
acknowledgments from destination nodes 103, with respect to the frame identified in 
step 312. 

If there outstanding responses, i.e., any outstanding acknowledgments from 
destination nodes 103, then transmitting node 101 may wait to receive a fiirther 
25 acknowledgment from another destination node 103 in step 308. 
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If tr^smitting node 101 has identified all the destination nodes 103 that were 
transmitted the frame identified in step 312 as having transmitted an 
acknowledgment, then in step 322, transmitting node 101 may release memory 
associated with a single copy of the frame identified in step 312. 

5 It is noted that methods 300, 600 may be executed in a different order 

presented and that the order presented in the discussion of Figures 3 and 6 are 
illustrative. It is further noted that certain steps may be executed almost concurrently. 

Although the system, computer program product and method are described in 
connection with several embodiments, it is not intended to be limited to the specific 
10 forms set forth herein, but on the contrary, it is intended to cover such altematives, 
modifications and equivalents, as can be reasonably included within the spirit and 
scope of the invention as defined by the appended claims. It is noted that the 
headings are used only for organizational purposes and not meant to limit the scope of 
the description or claims. 
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